Technical note: A computationally efficient algorithm for undiscounted Markov decision processes with restricted observations

We present a computationally efficient procedure to determine control policies for an infinite horizon Markov Decision process with restricted observations. The optimal policy for the system with restricted observations is a function of the observation process and not the unobservable states of the system. Thus, the policy is stationary with respect to the partitioned state space. The algorithm we propose addresses the undiscounted average cost case. The algorithm combines a local search with a modified version of Howard's (Dynamic programming and Markov processes, MIT Press, Cambridge, MA, 1960) policy iteration method. We demonstrate empirically that the algorithm finds the optimal deterministic policy for over 96% of the problem instances generated. For large scale problem instances, we demonstrate that the average cost associated with the local optimal policy is lower than the average cost associated with an integer rounded policy produced by the algorithm of Serin and Kulkarni Math Methods Oper Res 61 (2005) 311–328. © 2008 Wiley Periodicals, Inc. Naval Research Logistics 2009     

多决策目标排序的层次分析与灰色关联法

战争中对打击目标排序是下定作战决心的前提,是战场信息处理的重要内容.随着军事科技的发展和战术运用要求的提高,决定目标排序的因素不断增多,作战环境更加复杂,单一指标已不能满足需求.采用层次分析和灰色关联相结合的方法对多决策目标进行分析,为具有多决策因子目标提供了一种排序方法.灰色数据的白化和精确数据的直接使用提高了数据的效率,使得不同特点的目标具有可比性.实例表明,该方法行之有效.     

浅析达尔富尔和平进程及其面临的挑战

达尔富尔危机始于2003年2月。这场危机主要是由北方的游牧民与南方的定居农民之间对生存资源的争夺而引发的国内冲突。在国际社会的斡旋下，苏丹政府已与几个反政府武装签署了和平协议，并同意部署联合国-非盟混合维和行动，达尔富尔地区的和平进程已步入正轨。由于苏丹国内的复杂形势和困难，达尔富尔地区的和平进程仍面临诸多挑战，和平与和解之路仍然漫长。     

铁基非晶纳米晶涂层的耐磨性研究

采用基于机器人的自动化高速电弧喷涂技术在45钢基体上制备了FeCrBSiMnNbY非晶纳米晶涂层。研究了非晶纳米晶涂层在油润滑条件下，不同磨损时间、速度、载荷对涂层的磨损行为。采用扫描电镜（SEM）、能谱分析仪（EDAX）和X射线衍射仪（XRD）对涂层的组织结构进行了表征，利用纳米压痕仪对涂层的力学性能进行了分析，摩擦磨损试验在MM200滑块磨损试验机上进行。结果表明：涂层组织均匀，结构致密，主要由非晶相和α-Fe相纳米晶组成；在相同磨损试验条件下，非晶纳米晶涂层的相对耐磨性为3Cr13涂层的4．6倍，磨损机制主要为脆性疲劳剥落。     

考虑不完全维修的可修串联系统可用度模型

可用度是衡量系统可靠性、维修性水平的一个重要指标.提出一类基于gamma劣化过程的可修串联系统的可用度计算方法.该方法从构成系统部件的状态出发,用gamma过程刻画部件的退化失效规律,同时考虑系统维修效果的不完全性,在此基础上推导出系统可用度的表达式.最后用一个算例验证了研究模型的合理性.     

炮兵作战决策方案优选的方法

炮兵作战方案的选择,是炮兵作战指挥决策的关键环节,其合理与否,直接关系到炮兵作战效能的发挥和作战的成败.根据炮兵作战的实际,阐述了炮兵作战方案优选的依据,给出了运用层次分析法确定影响作战方案选择的各因素权重的方法步骤,在对优选依据的建模要素进行分析的基础上,构建了每个要素的效用函数计算模型,并给出了评估方案的计算方法,提供了模型应用的一般步骤.     

Level product form QSF processes and an analysis of queues with Coxian interarrival distribution

In this article, we study a class of Quasi‐Skipfree (QSF) processes where the transition rate submatrices in the skipfree direction have a column times row structure. Under homogeneity and irreducibility assumptions we show that the stationary distributions of these processes have a product form as a function of the level. For an application, we will discuss the ‐queue that can be modeled as a QSF process on a two‐dimensional state space. In addition, we study the properties of the stationary distribution and derive monotonicity of the mean number of the customers in the queue, their mean sojourn time and the variance as a function of for fixed mean arrival rate. © 2016 Wiley Periodicals, Inc. Naval Research Logisticsxs 66:57–72, 2019     

基于马尔可夫更新过程的装甲装备使用可用度模型

针对在装甲装备使用可用度评估中,采用统计评估法存在统计周期长和不能用于研制阶段的缺点,利用马尔可夫更新过程,建立了考虑工作时间、修复性维修时间、延误时间和预防性维修时间的装甲装备的稳态可用度模型,并进行了示例应用。该模型可以在装备研制阶段,根据装备各项时间参数的分布,来估计装甲装备的使用可用度,可为装备设计、装备维修间隔期规划等提供理论和方法指导。     

Optimal control policies in service systems with limited information on the downstream stage

Existing models in multistage service systems assume full information on the state of downstream stages. In this paper, we investigate how much the lack of such information impacts jobs' waiting time in a two‐stage system with two types of jobs at the first stage. The goal is to find the optimal control policy for the server at the first stage to switch between type‐1 and type‐2 jobs, while minimizing the long‐run average number of jobs in the system. We identify control policies and corresponding conditions under which having no or partial information, the system can still capture the most benefit of having full information.     

基于灰色层次分析法的侦察装备效能评估

针对侦察系统性能参数的不确定性,本文把灰色理论与层次分析法相结合,运用灰色层次分析综合评估模型,对侦察系统的效能进行评估。用专家评估分析法确定侦察装备效能评价指标权重,用灰色评估理论建立侦察系统效能评估模型。以某常规侦察雷达为例,用建立的模型进行量化评估,充分利用决策者的判断信息,较为准确地反映实际情况,验证了评估模型的可靠性。该模型可为部队作战提供装备的效能数据,为发展新型装备提供依据。其方法和成果可供其它武器系统效能评估时借鉴参考。